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BACKGROUND OF THE INVENTION 



FIELD OF THE INVENTION 



The present invention relates to an information 
10 delivery system, server, push delivery control unit, 
charging center, information delivery method, display 
control method, program and recording medium. 



DESCRIPTION OF THE RELATED ART 



Recently, information delivery services for 
delivering various content have been carried out . 

However, delivering the content (particularly, 
large volume content such as motion picture image 
20 content) as it is will consume a lot of network 
resources, resulting in a low efficiency. 

SUMMARY OF THE INVENTION 

25 In view of this, an object of the present 

invention is to provide an information delivery 
service capable of utilizing network resources 
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efficiently. 

In order to accomplish the above mentioned object, 
in the first aspect of the present invention, there is 
provided an information delivery system including a 
first server, a second server and a terminal, wherein 
the first server comprises: means for storing summary 
content which is a summary of detailed content; and 
means for transmitting the summary content to the 
terminal, wherein the second server comprises: means 
for storing the detailed content; and means for 
transmitting the detailed content to the terminal in 
response to an instruction of the terminal, and 
wherein the terminal comprises: means for receiving 
the summary content from the first server; means for 
displaying the received summary content; means for 
instructing the second server to transmit the detailed 
content corresponding to the received summary content; 
and means for receiving the detailed content 
corresponding to the received summary content from the 

second server. 

Here, the information delivery system may further 
comprise a push delivery control unit, the terminal 
may further comprise means for transmitting data about 
the terminal to the push delivery control unit, the 
first server may further comprise means for 
transmitting data about the summary content to the 
push delivery control unit, the push delivery control 
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unit may comprise: means for receiving the data about 
the terminal from the terminal; means for receiving 
the data about the summary content from the first 
server; means for deciding a terminal to which the 
5 summary content is to be transmitted according to the 
data about the terminal and the data about the summary 
content; and means for transmitting to the first 
server, information about the terminal which was 
decided to be the terminal to which the summary 
10 content was to be transmitted, and the first server 
may transmit the summary content only to the terminal 
which was decided by the push delivery control unit to 
be the terminal to which the summary content was to be 
transmitted. 

15 Here, the terminal may further comprise means for 

transmitting data about the terminal to the first 
server, the first server may further comprise: means 
for receiving the data about the terminal from the 
terminal; and means for deciding a terminal to which 

20 the summary content is to be transmitted according to 
the data about the terminal and data about the summary 
content, and the first server may transmit the summary 
content only to the terminal which was decided to be 
the terminal to which the summary content was to be 

25 transmitted. 

Here, the data about the terminal may include 
data about content display capability of the terminal, 
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and the data about the summary content may include 
data about display capability needed for displaying 
the summary content. 

Here, the data about the terminal may include 
5 data about a position of the terminal, and the data 
about the summary content may include data about a 
position associated with the summary content. 

Here, the data about the terminal may include 
data about a user of the terminal, and the data about 
10 the summary content may include data about attribute 
associated with the summary content . 

Here, the summary content may include a display 
control code for controlling display of content on the 
terminal, and the display control code may control 
is display of content on the terminal according to data 
about the terminal that differs from the data about 
the terminal which the terminal transmits . 

Here, the detailed content corresponding to the 
summary content may consist of moving image content, 
20 and the summary content may include a frame of the 
moving image content . 

Here, the summary content may include data 
describing a structure of the detailed content 
corresponding to the summary content . 
25 Here, the summary content may include a display 

control code for controlling display of content on the 
terminal . 
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Here, the display control code may control 
display of content on the terminal according to the 
data about the terminal. 

Here, the summary content may include structure 
5 description data describing a structure of the 

detailed content corresponding to the summary content, 
and the display control code may obtain information 
for receiving the detailed content according to the 
structure description data and control display of 
10 content on the terminal by using the obtained 
information. 

Here, the summary content may include data for 
authenticating the summary content. 

Here, the information delivery system may further 
15 comprise a charging center for charging for 

communication between the terminal the second server. 

Here, the charging center may decide a charging 
destination for the communication between the terminal 
and the second server according to an instruction from 
20 the second server. 

Here, when the second server receives information 
about exemption of the charging from the terminal, the 
second server may instruct the charging center to 
charge the second server for subsequent communication 
25 with the terminal. 

Here, the summary content may include the 
information about the exemption of the charging, or 
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information about generating the information about the 
exemption of the charging. 

Here, the second server may instruct the charging 
center to charge the second server for communication 
5 with the terminal, after completing the communication. 
Here, when the charging center receives 
information about exemption of the charging from the 
terminal, the charging center may charge the second 
server for subsequent communication between the 
10 terminal and the second server. 

Here, the terminal may be a mobile terminal. 
In the second aspect of the present invention, 
there is provided a server comprising: means for 
storing summary content which is a summary of detailed 
15 content; and means for transmitting the summary 
content to a terminal. 

Here, the server may further comprise: means for 
receiving data about a terminal from the terminal; and 
means for deciding a terminal to which the summary 
20 content is to be transmitted according to the data 

about the terminal and data about the summary content, 
and the server may transmit the summary content only 
to the terminal which was decided to be the terminal 
to which the summary content was to be transmitted. 
25 In the third aspect of the present invention, 

there is provided a push delivery control unit 
comprising: means for receiving data about a terminal 
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from the terminal; means for receiving data about 
summary content from a server that stores the summary 
content which is a summary of detailed content; means 
for deciding a terminal to which the summary content 
5 is to be transmitted according to the data about the 
terminal and the data about the summary content; and 
means for transmitting to the server, information 
about the terminal which was decided to be the 
terminal to which the summary content was to be 

10 transmitted. 

In the fourth aspect of the present invention, 
there is provided a terminal comprising: means for 
receiving summary content which is a summary of 
detailed content from a first server that stores the 

15 summary content; means for displaying the received 

summary content; means for instructing a second server 
to transmit the detailed content corresponding to the 
received summary content; and means for receiving the 
detailed content corresponding to the received summary 

20 content from the second server. 

In the fifth aspect of the present invention, 
there is provided a charging center comprising: means 
for charging for communication between a terminal and 
a server storing content; and means for receiving an 

25 instruction from the server, wherein the charging 

center decides a charging destination according to the 
instruction from the server and charges the decided 
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charging destination. 

In the sixth aspect of the present invention, 
there is provided a charging center comprising: means 
for charging for communication between a terminal and 
5 a server storing content; and means for receiving 
information about exemption of the charging from the 
terminal, wherein the charging center charges, when 
the charging center receives the information about 
exemption of the charging from the terminal, the 

10 server for subsequent communication between the 
terminal and the server • 

In the seventh aspect of the present invention, 
there is provided an information delivery method in an 
information delivery system including a first server 

is that stores summary content which is a summary of 
detailed content, a second server that stores the 
detailed content, and a terminal, the information 
delivery method comprising the steps of : transmitting 
the summary content from the first server to the 

20 terminal; displaying on the terminal the received 

summary content received by the terminal; instructing 
the second server to transmit the detailed content 
corresponding to the summary content received by the 
terminal; and transmitting the detailed content 

25 corresponding to the summary content received by the 
terminal from the second server to the terminal. 

In the eighth aspect of the present invention, 
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there is provided a display control method for 
controlling display of content on a terminal, 
comprising the steps of : obtaining information for 
receiving content according to structure description 
5 data describing a structure of the content; and 
controlling display of content on the terminal by 
using the obtained information. 

In the ninth aspect of the present invention, 
there is provided a program that makes a terminal to 

10 execute a display control method for controlling 
display of content on the terminal, the display 
control method comprising the steps of: obtaining 
information for receiving content according to 
structure description data describing a structure of 

15 the content; and controlling display of content on the 
terminal by using the obtained information. 

Here, the display control method may obtain the 
information for receiving content according to the 
structure description data and data about the terminal. 

20 In the tenth aspect of the present invention, 

there is provided a recording medium for recording a 
program that makes a terminal to execute a display 
control method for controlling display of content on 
the terminal, the display control method comprising 

25 the steps of: obtaining information for receiving 
content according to structure description data 
describing a structure of the content; and controlling 

- 9 - 



1 1 Id ' 'I" 



display of content on the terminal by using the 
obtained information. 

The foregoing configuration can provide 
information delivery services that can make effective 
5 use of the network resources. It can also push 

content effectively and easily which include audio- 
visual media stimulating the five senses, and which 
aim to advertise commercial products and stores and to 
promote other entities. Thus, it can provide users 

10 with visual selecting means of the content. 

The above and other objects, effects, features 
and advantages of the present invention will become 
more apparent from the following description of 
embodiments thereof taken in conjunction with the 

15 accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing a configuration 
20 of an information delivery system of an embodiment in 
accordance with the present invention; 

Fig. 2 is a block diagram showing a detailed 
internal configuration of a terminal of the embodiment 
in accordance with the present invention; 
25 Fig. 3 is a diagram showing an arrangement of a 

page of multimedia web content; 

Fig. 4 is a diagram showing a configuration of 
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summary content of the embodiment in accordance with 
the present invention; 

Fig* 5 is a block diagram illustrating a charging 
example for communications between a terminal and a 
5 pull server; 

Fig* 6 is a block diagram showing another 
configuration of an information delivery system of an 
embodiment in accordance with the present invention; 
and 

10 Fig- 7 is a diagram showing an example in which 

summary content is displayed on a terminal. 



DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 



15 An embodiment in accordance with the present 

invention will now be described in more detail with 
reference to the accompanying drawings. 

Fig. 1 is a block diagram showing a configuration 
of an information delivery system of the embodiment in 
20 accordance with the present invention. The 

information delivery system can deliver multimedia web 
content including audio-visual (AV) media efficiently 
by customizing them according to users' environments. 
The information delivery system comprises a terminal 
25 1 # a push delivery controller 2, a push server 3 and a 
pull server 4, as its main components. 

In the information delivery system, the push 
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server 3 delivers summary content to the terminal 1 by 
push, the summary content being a summary of detailed 
content and stored in the push server 3. The terminal 
1 displays the received summary content. The summary 
5 content is displayed in a f orm that links for the pull 
operation are provided. 

The detailed content stored in the pull server 4 
is delivered in response to a pull (transmission 
request) from the terminal 1, Thus, watching the 

10 summary content, the user of the terminal 1 can send a 
transmission request to the pull server 4 only when he 
or she wishes to acquire the detailed content. 

Fig. 7 is a diagram showing an example in which 
summary content is displayed on the terminal 1. In 

15 regard to baseball, a headline 41, a headline picture 
42 and links 43, 44 are displayed on a liquid crystal 
display 40 of the terminal 1. If a user want to watch 
detailed content of "home run", the user can operate 
buttons 50 to select the link 43. When the link 43 is 

20 selected, the terminal 1 sends a transmission request 
of the detailed content of "home run" to the pull 
server 4 which stores the detailed content. Receiving 
the transmission request, the pull server 4 transmits 
the detailed content of "home run" to the terminal 1. 

25 Then, the terminal 1 displays the received detailed 
content of "home run" . 

Although it is assumed that the push delivery 
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controller 2 transmits (pushes) only summary content 
such as one that the user of the terminal 1 will be 
interested in to the terminal 1 in the present 
embodiment, it can send all the summary content 
5 without setting such a limit. 

The terminal 1, having an Internet access 
function, can receive and display multimedia web 
content produced in a prescribed format through the 
network 5, Although the terminal 1 may be a fixed 

10 personal computer, mobile information terminal or 

mobile terminal with an Internet function, the present 
embodiment assumes a mobile terminal. Furthermore, 
assuming that the push delivery controller 2 is 
connected to the push server 3 and pull server 4 via 

is the Internet, and to the terminal 1 through a mobile- 
specific network (such as a WAP (Wireless Application 
Protocol) network) , the push delivery controller 2 can 
be considered as a functional block inside the gateway 
between the two networks. 

20 It is further assumed that the user supplies the 

terminal 1 with user description data 7 stored in an 
external storage medium 6 like an IC card in advance. 
The user description data 7 includes the following 
information, for example. 

25 - Personal information about the user (age, sex, 

address , etc . ) 

- Genres of the content the user wants to view 
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(sport, music, economy, etc.) 

- Content performers the user likes (names of 
actors or actress, of singers, etc.) 

The user description data 7 are protected such 
5 that they cannot be updated except for such cases as 
the user intends to rewrite them, or allows them to be 
automatically rewritten. In addition, it is assumed 
that the user description data 7 are not transmitted 
outside the terminal 1 unless the user allows it. To 

io achieve this, the terminal 1 comprises a user 

description management section 8 for protecting and 
managing the user description data 7 (see. Fig. 2). 
The user description management section 8 has the 
following functions . 

15 - User authentication function (Compare the 

unique information about the user which is stored in 
the terminal 1 in advance with the input user 
description data 7 ) . 

- Update function of the user description data 7 
20 according to a request from the user. 

- Supporting function of creating new user 
description data. 

- Setting function of data access control by the 
user (automatic update, and transmission to outside). 

25 - Automatic update and external transmission 

function of the user description data 7 in a range 
permitted. 
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- Interface function with the access from a 
content display control code 19 which will be 
described later. 

According to the foregoing functions, the user 
5 description data 7 are roughly divided into private 
data 9 and public data 10. The private data 9 are 
user description data that cannot undergo the 
automatic update or external transmission. In 
contrast, the public data 10 are user description data 

io the system can apply the automatic update to or 

transmits to the outside of the terminal such as the 
push server 3 via the network 5. The following 
formats are applicable to the user description data: 
User Preferences DS ( "Multimedia Description Schemes 

15 XM" , http : / /www . cselt . it /mpeg/public /mmds„xm . zip ) 
which is currently for standardization by MPEG- 7 
(Moving Picture Experts Group 7); and P3P (Platform 
for Privacy Preferences Project, "The Platform for 
Privacy Preferences 1.0 (P3P 1.0) Specification", W3C 

20 Working Draft 10 May 2000, http://www.w3.org/TR/P3P/) 
which is currently for standardization by W3C. 

The terminal 1 transmits the following data to 
the push delivery controller 2 via the network 5 when 
establishing a session needed for the push delivery by 

25 this system in a prescribed coding language such as 

XML (Extensive Markup Language): The public data 10 in 
the user description data 7; terminal position data 
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(data about the position at which the terminal is 
present) 11 acquired by a position identifying 
technique such as the GPS (Global Positioning System); 
and data about the medium display processing 
5 capability (terminal capability data 12) of the 
terminal . 

The terminal position data 11 can use a format 
such as POIX (Point Of Interest exchange language, 
"POIX: Point Of Interest exchange Language 

10 Specification", W3C Note-24 June 1999, 

http: //www.w3 . org/TR/poix/ ) which is currently for 
standardization by W3C (World Wide Web Consortium) ; 
and Place DS of MPEG-7. The terminal capability data 
12 can use a format such as CC/PP (Composite 

is Capability/Preference Profile, "Composite 

Capability/Preference Profiles (CC/PP); a user side 
framework for content negotiation", W3C Note 27 July 
1999, http://www.w3.org/TR/N0TE-CCPP/) which is 
currently for standardization by W3C; and User Agent 

20 Profile in WAP forum (UAPROF, "Wireless Application 
Group User Agent Profile Specification", Version 10, 
Nov. 1999, 

ht tp : / /wwwl . wapf orum . org/ tech/document s /WAP -174- 
UAProf-19991110-a.pdf) . 
25 First, a session setup procedure needed for the 

push delivery will be described. The push server 3 is 
connected to the Internet, and notifies the push 
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delivery controller 2 of a fact that it is ready for 
the push delivery (delivery request) by negotiation 
information 13. Receiving the delivery request from 
the push server 3, the push delivery controller 2 
5 inquires of all the target terminals to receive the 

services whether they are ready for accepting the push 
delivery by means of negotiation information 14. 
Making a decision to accept the delivery, the terminal 
1 establishes the session according to the negotiation 

10 information 14, and transmits the user description 
data 7 (only the public data 10), terminal position 
data 11, and terminal capability data 12 to the push 
delivery controller 2. 

On the other hand, the push server 3 also 

is transmits the following content-associated information 
to the push delivery controller 2 along with a 
delivery request by means of the negotiation 
information 13. It is preferable that these items of 
information have the same format as the data 

20 transmitted from the terminal 1 to facilitate the 
comparison . 

- Data about terminal capability required to 
display the content to be pushed. 

- Position data associated with the content (such 
25 as area information included in the content). 

- Various items of attribute information 
associated with the content (genres of the content, 
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famous names in the content, characters of the content 
svich as for the young/old, men/women, etc.) 

The push delivery controller 2 compares the user 
description data (public data 10), terminal position 
5 data 11 and terminal capability data 12 which are 
transmitted from the terminal 1 with the content - 
associated information transmitted from the push 
server 3 , selects the terminals with appropriate 
receiving conditions, and makes a decision as to 

10 whether the delivery is acceptable or not. When 

terminals with the appropriate receiving conditions 
are not included in the target terminals to receive 
the services, the push delivery controller 2 notifies 
the push server 3 of the fact that the delivery is 

15 impossible using the negotiation information 13. 

According to the foregoing procedures, the user of the 
terminal 1 can receive the appropriate push delivery 
in accordance with his or her interest or positional 
condition. 

20 The push delivery controller 2 can be configured 

such that it can cache the user description data 10, 
terminal position data 11, and terminal capability 
data 12 to be used for the services for a 
predetermined time period. The cached data can be 

25 rewritten or erased in response to a request from the 
terminal. For example, the terminal 1 may request the 
update of the terminal position data 11, when the 
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position of the terminal 1 changes with the move of 
the user, and the rate of the movement is very large 
such as moving by car. Besides, the push delivery 
controller 2 may erase the content of the cache to 
5 make effective use of the cache resources, when the 
user does not utilize the service for more than the 
predetermined time, or when the service terminates. 

As for the user description data 10, terminal 
position data 11, and terminal capability data 12, the 

10 push server 3 can receive and utilize them to select 
the detailed content. In such a configuration, a site 
that can deliver various content can further arrange 
the content to undergo the push delivery in the push 
server 3, thereby generating the delivery content 

is specialized for the user. In such a case, the site 
can generate the content that will release the push 
delivery controller 2 from the need for selecting the 
delivery destination or for making a decision as to 
the acceptability of the delivery, thereby offering an 

20 advantage of being able to reduce the processing load 
of the push delivery controller 2 . 

The push server 3 must deliver the content 
including information that requires a great volume of 
network resources such as AV media. Accordingly, it 

25 transmits only the summary of the content (called 

"summary content 15" from now on) to the user rather 
than delivering the entire content . The summary 
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content 15 includes a device enabling the user to gain 
access to more detailed content or to the information 
associated with the content. 

The structure of the summary content 15 will now 
5 be described taking an example of delivering news 

content. For example, complete multimedia web content 
for the news delivery have a page structure as shown 
in Fig. 3. A page includes headlines and detailed 
report of the news in a text region. In addition, it 

10 has a picture for representing a specific headline in 
the form of still picture data such as JPEG. 
Furthermore, it offers the content of moving pictures 
( including accompanying audio in almost all cases ) . 
To achieve the reproduction or to specify the link 

is destination of the moving pictures intuitively, 

graphics such as icons plus buttons are utilized. In 
addition, to display advertisements of sponsors of the 
page, animation can be used. To place these various 
types of media in the screen, it is common to use a 

20 display description language typified by HTML 

(Hypertext Markup Language) to make page description 
using appropriate authoring tools. 

From the standpoint of a content provider, it is 
preferable that such content be delivered to all 

25 devices having an Internet browser. However, it is 

necessary for the content to be adapted to the display 
capacity of each device to deliver the content to 
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devices such as mobile terminals with limited display 
capacity and screen size. For example, R. Han, et al. 
propose a technique to carry out dynamic adaptation of 
the content by the proxy of a network in "Dynamic 
5 Adaptation in Image Transcoding Proxy for Mobile Web 
Browsing" (IEEE Personal Communications, Dec. 1998). 
For example, to deliver the content of Fig. 3 to the 
browser loaded on the mobile terminal, a first page is 
made of the headlines only, and the adaptation of the 

10 content is carried out such that links lead to their 
details in the form of "one-to-multiple pages" (For 
example, "Portal-To-Go" of Oracle Corp.). On the 
other hand, from the viewpoint of the load of the 
system, it is undesirable to carry out the dynamic 

is adaptation individually to deliver the content to a 
variety of terminals. To provide services with 
reduced system load, it will be rather advantageous to 
select or format the content to be delivered according 
to the types of selected terminals by preparing a 

20 plurality of types of the content according to the 
specific terminal standards expected as the target 
terminals of the services, or by storing common 
content elements in a specified database to format 
them only to display at the access time. 

25 Incidentally, since the AV media for displaying 

moving pictures require a great amount of network 
resources for transmitting them, they are usually 
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provided in the format as shown in Fig. 3, in which 
only the initial frame is displayed in a still image, 
and a click of a reproduction button can start a 
streaming delivery as needed. It is difficult for the 
method, however, to efficiently deliver the content 
with a variety of topics like news delivery by the AV 
media. Thus, they are limited to only auxiliary use 
to supplement specific topics. However, to transmit 
the AV media in their entirety, it is unavoidable to 
consume more network resources than are necessary in 
proportion to the amount of information. 

To solve the problems, the present invention 
composes the summary content 15, which are delivered 
from the push server 3 to the terminal 1, of the 
following items of information, thereby making it 
possible to deliver visually self-explanatory summary 
content by positively setting the AV media at the 
center (see, Fig. 4). 

- text data 16 (including simple graphics data 
such as icons). 

- key- frame set 17 of the AV media. 

- AV-media- structure description data 18. 

- content display control code 19 . 

- content authentication data 20. 

The summary content 15 with the structure enables 
visual content browsing centered on the images 
consisting mainly of the key-frame set 17. The text 
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data 16 is used as required minimum for describing 
events indicated by the key frames (a meaning of the 
content whose representative images are key frames). 
Since they are statements of the key frames themselves, 
5 they can be considered to be part of the AV-media- 
structure description data 18 that will be described 
later. 

The AV-media- structure description data 18 
describes the physical- semantic structure of the full 
10 AV media (detailed content) stored in the pull server 
4. The data 18 describes the time when each key frame 
is present in the full AV media, and the events 
associated with the key frames included in the summary 
content . 

15 As for the content display control code 19, a 

scheme can be used in which the code 19 is transmitted 
in such a form as Java Applet, and operates on a Java 
execution environment (Java VM) on the receiving 
terminal. The functions of the content display 

20 control code 19 include the following. 

- Controlling layout development of the key- frame 
set 17 and text data 16 on the browser of the terminal 
1. 

- Carrying out display control considering user 
25 description data (mainly private data 9) that have 

been input to the terminal 1 (such as displaying 
interested items on a priority basis, filtering 
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display information considering the private data 9, 
etc. ) . 

- Unwrapping the structure description data 18, 
managing the logical relationships (such as 
5 corresponding time and corresponding key events) 

between the received key- frame set 17 and the full AV 
media stored in the pull server 4, and controlling 
responses to user interaction 22. 

The content authentication data 20 is used to 

10 verify whether the delivered summary content 15 is 
right content delivered in response to the request 
from the user to prevent a third party from inputting 
wrong content to the terminal 1. This is implemented 
by transmitting the summary content using MIME 

15 (Multipurpose Internet Mail Extensions), for example, 
and by utilizing the authentication procedure provided 
by MIME. 

Receiving the delivered summary content 15 with 
the foregoing format, the terminal 1 can visually 

20 browse the key events in the content in the form of 
image data consisting mainly of the key frames . In 
addition, since the summary content 15 includes a code 
for carrying out the key frame display control for the 
browser, it is not necessary for the terminal to 

25 comprise any other components than the Java execution 
environment . 

In this embodiment, the summary content 15 which 
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is composed of the above mentioned information. 
However, it is possible to leave the information other 
than the content display control code 19 of the 
summary content 15 on the push server 3, and make the 
content display control code 19 obtain the information 
by interacting with the push server 3 only when the 
content display control code 19 needs the information. 

As for the extraction of the key-frame set 17, it 
is expected to be performed automatically to some 
extent based on the existing research results during 
the content authoring. For example, R. Brunelli, et 
al., introduce many techniques in "A Survey on the 
Automatic Indexing of Video Data" (Journal of Visual 
Communication and Image Representation 10, 1999). 
Thus, the summary content 15 can be generated when the 
automatic extraction of the key frames and the smart 
interactive operation associated with the key events 
are supported in the authoring tool. The present 
embodiment does not include any content authoring 
system. 

Information included in the summary content 15 
such as the content display control code (program) 19 
can be written into a recording medium (for example, 
CD-ROM, magnetic disk) and read from the recording 
medium . 

As described above, appropriate summary content 
15 is sent to the terminal 1 in accordance with the 
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interest and conditions of the user. Next, the pull 
operation of the detailed content 23 by the terminal 1 
using the summary content 15 will be described with 
reference to a detailed internal configuration of the 
5 terminal 1 as shown in Fig. 2. Here, the detailed 

content 23 may be files of the foregoing full AV media, 
or web content description including the full AV media. 
The mechanism for capturing the detailed content by 
the pull access based on the summary content is 
10 effective in the following cases, for example. 

- First case: Delivering a key-frame set 
representing key events of sport news such as a scene 
of a homerun, a goal scene of a soccer game, or a pat 
scene in a golf game as the summary content, and 
15 delivering detailed video scene including the 

foregoing scenes in response to the pull request from 
the user. The key events can be acquired from the 
user description data 7, and a manner of displaying 
the key frames on the terminal 1 can be controlled 
20 according to the interest of the user in the key 

events. It is also possible to transmit information 
about sport events in the neighborhood of the key 
events according to the position of the user. 
- Second case: Delivering latest CD score 
25 information in the form of the key-frame set 

representing a video clipboard (any sources are 
acceptable such as music programs on television), and 
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delivering a detailed video clipboard in response to a 
user request. It is also possible to handle the 
content reflecting the chart of the area according to 
the user position. 

5 - Third case: Multimedia town guidance service. 

Various items of town information about the 
neighborhood of the current user position are 
delivered with the video clipboard. For example, an 
image of entrances of restaurants in the neighborhood 

10 are push delivered as a key- frame set so that the user 
can visually check the inside of the restaurants as 
needed. 

The summary content 15 is push delivered to the 
terminal 1 after the foregoing components are coded 

15 according to prescribed protocol and format such as 
HTTP, MIME or XML. The terminal 1 disassembles the 
summary content 15 into their components with a purser 
24, first. Subsequently, a content authentication 
section 25 verifies the summary content 15 according 

20 to the content authentication data 20. When they are 
verified, the content display control code 19 operates 
on the Java execution environment 26 in the terminal 1 
to develop the data to be used for the display such as 
a key frame set 17 and text data 16 on a memory 27. 

25 Image media such as the key frames are developed on 
the memory 27 via a special purpose media decoder 100 
as needed. The content display control code 19 
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includes a program having layout rules for displaying 
the data in the memory 27 on a browser, and designs 
layout of the data on a browser 28. Thus, changing 
the program of the content display control code 19 
5 enables a variety of display layouts that make full 
use of the characteristics of the push content 
provider. In addition, a configuration is also 
possible that makes the standard display control 
engine resident in the terminal 1 without including 
10 the content display control code 19. In this case, 

the transmission charge of the summary content can be 
reduced by an amount of skipping the transmission of 
the content display control code 19 . 

In this case, a configuration is possible which 
15 carries out the display control reflecting the 

interest of the user by reading the private data 9 
from the user description data 7, and by developing 
the private data 9 on the memory 27. For example, 
consider the case where the received summary content 
20 15 falls into a plurality of sub -genres such as 

baseball, soccer in the sport. It will be possible in 
this case to consider the interest of the user in the 
sub-genres, so that the key frames the user is most 
interested in among the key- frame set 17 are displayed 
25 on a priority basis. In addition, the summary content 
can be arranged such that they can pass through the 
information filtering by the private data 9 utilizing 



- 28 - 



the property of the private data 9, thereby making it 
possible to provide information passing through two 
step filtering consisting of a public phase (push 
delivery side) and a private phase (terminal side). 
5 For example, consider the case where the private data 
includes age, sex and the like. In this case, the 
push content which is selected according to the user's 
interest or taste that can be made public are further 
selected according to the age or sex to be displayed 
10 on the receiving terminal. 

Furthermore, it is necessary for the content 
display control code 19 to decode the AV media 
structure description data 18 associated with the key- 
frame set 17 before generating information needed for 
15 the pull operation of a user interaction 22. The AV 
media structure description data 18 can use MPEG- 7 
Summarization DS or MPEG- 7 Segment DS as its format, 
for example. The AV media structure description data 
18 store information about the key frames indicating 
20 which of them correspond to which times in the full AV 
media, or about the URLs (Uniform Resource Locators) 
of the full AV media 21 represented by the individual 
key frames; and various items of attribute information 
associated with the key frames (such as event 
25 information corresponding to the key frames, and 

information about subjects in the key frames). The 
content display control code 19 extracts and generates 
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the following two pieces of information primarily from 
the AV media structure description data 18. 

- Locator information: The address information of 
the full AV media corresponding to the key frames. 
When the full AV media consists of a single stream 
file, the locator information indicates one of the 
times in the stream file. When the full AV media are 
divided into shot units corresponding to the key 
frames, the locator information describes their URLs. 
Alternatively, the locator information indicates the 
URL of the entire detailed web content 23 including 
the full AV media corresponding to the key frames. 

- Annotation information: Generating URLs to be 
used as associated links from the various attribute 
information associated with the key frames, or 
generating links with a format that can be output as 
keywords to a text-based web search engine. 

The extracting and generating processing of the 
information can also be controlled using the private 
data 9. For example, such a configuration will be 
possible in which only the annotation matching the 
user interest can be made link information for the 
pull operation. 

According to the foregoing configuration and 
process, the summary content, in which the links for 
the pull operation are provided in accordance with the 
interest of the user, is displayed on the browser 28. 



- 30 - 



Using these links, the user can receive the detailed 
content 23 by the pull operation as needed. In the 
pull operation, the detailed content 23 can be 
received either in the download type based on the HTTP, 

5 or in the streaming type based on RTSP (Real-time 
Streaming Protocol). 

The locator information that is sent to the pull 
server 4 when making the pull access from the key 
frames can be the URL indicating the physical location 

10 of the detailed content 23, or any time or time period 
in the detailed content. The former is applied to a 
case where the detailed content 23 is physically 
divided to be stored, while the latter is applied to a 
case where the detailed content 23 is collected into a 

15 single unit, the inside of which is accessible at 
random . 

It is common to charge for the communications 
made by the terminal 1. However, there will be some 
cases where the user of the terminal 1 is not billed 

20 for viewing the content. Allowing the user to view 
the content without charge enables the user to obtain 
a variety items of information, while the advertisers 
can gain wide viewers of the content. 

As a method to exempt the user from the charge 

25 for the pull access, it will be possible to utilize a 
one-time password. In this case, the summary content 
15 can include one-time password generating trigger 
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information so that the user can take an action for 
the one-time password generating trigger information 
at the terminal 1 to generate the one-time password. 
The one-time password generating trigger information 
5 is questionnaire page description data, for example. 
It is assumed that when the user fills out the 
questionnaire and transmits it, the one-time password 
is generated . Since the survey is closely related to 
the content, it is preferable that the questionnaire 

10 page description data be made for each content. Thus, 
it is preferable that the questionnaire page 
description data be included in the summary content 15. 
The content display control code 19 is assumed to 
have a one-time password function according to the 

15 one-time password generating trigger information and 
the user input. In this way, the user of the terminal 
1 can obtain the one-time password. It is also 
possible to transmit the one-time password itself to 
the terminal 1 instead of transmitting the one-time 

20 password generating trigger information. 

The pull server 4 comprises the user 
authentication section for receiving the one-time 
password and for conducting the authentication. After 
receiving the one-time password, the pull server 4 

25 accepts a request from the same user for a 

predetermined time period (within one hour, for 
example) , and delivers the detailed content 23 to the 
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user sending the free request. When the one-time 
password is generated for each detailed content , it is 
possible to exempt the user from the charges for part 
of the detailed content corresponding to the one-time 
5 passwords rather than from the charge for the 
predetermined time period. 

When the one-time password is not used, the 
charge for the pull access is tentatively levied on 
the user of the terminal 1. However, when the 

10 communication between the terminal 1 and the pull 
server 4 is completed, the pull server 4 pays the 
charge for the request for the detailed content 23 
back to the user of the terminal 1 . 

Fig. 5 is a block diagram illustrating an example 

15 of charging for the communication between the terminal 
and the pull server. The communication is carried out 
by means of packet communication, for example. 

(1) A charging center 31 temporarily reserves the 
charging when a prescribed access scheme occurs. For 

20 example, when the access pattern takes place that the 
user viewing the summary content can make, the 
charging is reserved. Alternatively, when the 
communication based on the RTSP is carried out during 
the communication normally based on the HTTP, the 

25 charging is reserved. Furthermore, when it is found 
from the party address contained in the packet that 
the party is a specific one, the charging is reserved. 
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Subsequently, the charging center 31 decides the 
charging destination according to the pull server 
selection information from the terminal 1, or 
according to the feedback information from the pull 
5 server, and starts the charging* The charging center 
31 has a function of making a decision of the charging 
destination according to the pull server selection 
information (usually, the URL) from the terminal 1, 
which corresponds to the common access to a web server, 
10 and a function of deciding the charging destination 
according to the feedback information from the pull 
server. Only when the former makes a decision that 
"the pull server bears the cost", the latter operates. 

(2) The pull servers 4a- 4c make a decision as to 
15 whether they will bear the charge for the access (the 

communication with the terminal 1) according to the 
authentication information such as one-time password 
transmitted from the terminal 1, and transmits the 
information about the decision to the charging center 
20 31. 

(3) Receiving the instruction that the pull 
servers bears the charge, the charging center 31 
charges the pull server for all the transmitted and 
received packets including the pull access from the 

25 terminal 1. In contrast, when the pull servers do not 
bear the charge as in common web server or 
unauthorized access, the charging center 13 charges 
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the terminal 1 . 

The charging center can be configured such that 
it has an authentication function of a one-time 
password sent in advance from a pull server registered 
5 as a service provider, and decides the charging 
destination directly from the pull access. Thus, 
receiving an authorized one-time password from the 
terminal, the charging center can charge the pull 
server for the subsequent communications between the 

10 terminal and the pull server. In this case, although 
the charging center holds the authentication function 
for each pull server, since it becomes unnecessary to 
decide the charging destination by monitoring the 
subsequent packet streams, the load of monitoring the 

15 entire communication procedure can be reduced. In 

addition, as for the authentication function for each 
pull server, it becomes unnecessary for the charging 
center to prepare a plurality of authentication 
functions when a standard procedure is determined as a 

20 service in advance, thereby making it possible to 
reduce the load of implementation. 

The present embodiment implements the function of 
enabling a user to visually check a rough outline of 
the detailed content 23 by providing the summary 

25 content 15 with the key-frame set 17, and by 

explicitly displaying it to the user using the content 
display control code 19. This reflects the 
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consideration of a fact that the detailed content 
cannot be seen at all if the summary content is 
described using the page description language such as 
HTML, and if the user provides no explicit interaction. 
5 The detailed content 23 corresponding to the key 

frame selected by the user can be delivered to the 
terminal 1 in such a manner that they are dynamically 
specified according to the view conditions the user 
desires by transmitting the media structure 

10 description data 18 together that describes the 

logical relationships between the key- frame set 17 and 
detailed content 23 . This means that any portion of 
long real-time media can be selectively specified to 
be reproduced. 

15 In this embodiment, the push server 3 delivers 

the summary content 15 to the terminal 1 by push under 
control of the push delivery controller 2. However, 
for example, it is possible to configure the push 
server 3 as a pull server, and make the terminal 1 

20 send a transmission request of the summary content to 
the pull server to obtain the summary content* 
Fig. 6 is a block diagram showing another 
configuration of the information delivery system of 
the embodiment in accordance with the present 

25 invention. In the configuration of Fig. 6, a pull 

server 3 ' is installed in place of the push server 3 
of Fig, 1. The pull server 3' deliver the summary 
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content 15 in response to a summary content 
transmission request 33. The terminal 1 can obtain 
the detailed content 23 in accordance with the 
detailed content locator/link 32, 
5 The pull server 3 ' can have the function of the 

push delivery controller 2. The summary content 
transmission request 33 can include the terminal 

Q capability data 12, the user description data 7, etc, 

5 The pull server 3' can decide whether the terminal is 

10 a terminal to which the summary content should be sent 

J2 based on the terminal capability data 12, the user 

J3. description data 7, etc. 

O For example, in HTTP, description data about 

ft] terminal type can be sent to the pull server 3' and by 

5 is extending this mechanism, information for negotiating 

^ about transmission and reception of content can be 

exchanged between the terminal 1 and the pull server 
3 ' * That is , if the terminal side uses a terminal 
with low display capability which accepts QCIF 
20 resolution only, the server side can consider that 
point and provide low resolution content. 

As described above, the present invention can 
provide information delivery services utilizing the 
network resources efficiently. In addition, it 
25 enables the user to acquire multimedia web content 

matching his or her interest or conditions at low cost, 
and to receive detailed content as needed. Thus, the 
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present invention can provide a system that can 
deliver the web content using AV media with high 
transmission cost efficiently. It also enables the 
service providers to introduce hierarchical charging 
5 system presupposing secondary access to the detailed 
content, and to achieve multimedia content delivery to 
a large number of users by making effective use of the 
network resources . 

The present invention has been described in 

10 detail with respect to a preferred embodiment, and it 
will now be apparent from the foregoing to those 
skilled in the art that changes and modifications may 
be made without departing from the invention in its 
broader aspects, and it is the intention, therefore, 

15 in the appended claims to cover all such changes and 
modifications as fall within the true spirit of the 
invention. 



- 38 - 



